INVARIANTS AND ORTHOGONAL 
g-POLYNOMIALS ASSOCIATED WITH C,(osp(l,2)) 



Yi Ming Zou 

Abstract. The spaces of invariants and the zonal spherical functions associated 
with quantum super 2-shpheres defined by Cq{osp{l,2)) are discussed. Connection 
between the zonal spherical functions and orthogonal ijr-polynomials from the Askey- 
Wilson scheme is investigated. 



1. Introduction 

The study of the spherical functions on symmetric spaces can be traced back to 
Cartan in the 1920s. Since the late 1980s, this theory has been generalized to quan- 
tum group and quantum homogeneous spaces began with [Ko, MNU] (see [Di, Le] 
for an outline of the philosophy of these approaches and the major steps, as well as 
some recent developments). In this paper, we study homogeneous spaces and spher- 
ical functions associated with the quantum supergroup C^(osp(l, 2)) introduced in 

[Z]- 

Let G be a contragredient Lie superalgebra over the field C with a symmetrizable 
Cartan matrix, let U{G) be the universal enveloping algebra of G, and let Uq{G) 
be the quantized enveloping algebra of G. Both U{G) and Uq{G) are Z2-graded 
Hopf algebras. Let C[G] and Cg[G] be the supergroup and the quantum supergroup 
corresponding to G constructed from the coordinate rings of U{G) and Uq{G) re- 
spectively. By using the Z2-graded Hopf algebra structure, we define a left action L 
and a right action R of U{G) on C[G] (similarly for the actions of Uq{G) on Cg[G]) 

by 

(1.1) L.,{u) = ^(-1)P(-)P("1)U2(X)U1, i?,(w) = M^)U2, 

where x G U{G), u e C[G], p{x) is the parity function associated with the Z2- 
grading, and A(m) = ^ui®U2- 

For x,y € U{G) and u, u' £ C[G], we have 

(1.2) Lxy = LxLy, Rxy = (^l)'''' ^^^^^ RyRx^ 

(1.3) RxLy = {-ly^^-^p^y^LyRx, 

(1.4) Lx{uu') = ^(-l)f(«)''(-^)L,,(w)i,,(u'), 

(1.5) Rxiuu') - ^(-l)P(")f(-^)i?,,(7.)i?,,(u'), 



1991 Mathematics Subject Classification. 17B35, 17B60, 17B70, 22E70. 

Typeset by AjvlS-TW^ 



2 



YI MING ZOU 



where xi and X2 arc defined by A (a;) = '^xi (g) X2- 

View the elements of U{G) as functions on C[G], then for x,y G U{G) and 
w e C[G], we have 



where e is the counit of U{G), can be considered as the homogeneous space defined 
by J with the right action of C[G] given by the comultiplication (see [DK]). We call 
the elements of the left J-invariant subspace of Bj 



spherical functions on the homogeneous space Bj. We remark that by symmetry, 
one can also first consider the left invariants to obtain homogeneous spaces and 
then take the right invariants to be the spherical functions. 

If the algebra G is a semisimple Lie algebra and the homogeneous space is a 
compact symmetric space defined by a maximal compact subalgebra K of G, then 
by the Peter- Weyl's theorem, the representative ring of the pair (G, K) is a direct 
sum of irreducible representations of G, and the zonal spherical functions in each 
of the irreducible components can be expressed by certain special functions (e.g. 
hypergeometric functions). It turns out that this theory can be extended to the 
quantum groups, and the spherical functions associated with the quantum symmet- 
ric pairs can be expressed in terms of g-hypergeometric polynomials (see [Ko, DN, 
Le]). In the super case, since the lack of reducibility for the representations of G in 
general, one needs to take different approach to the invariant and spherical function 
theory. In [ZZ], the first fundamental theorem of invariant theory of general linear 
supergroup was applied to investigate the spherical functions on certain homoge- 
neous superspaces associated with general linear supergroup, these homogeneous 
superspaces include the projective superspace C[P"~^'™]. The results in [ZZ] show 
that depends on m and n, the space of the spherical functions on C[P"~^I™] may or 
may not decomposes into the direct sum of the eigenfunctions of the Laplacian op- 
erator (zonal spherical functions). For the contragredient finite dimensional simple 
Lie superalgebras, osp{l,2n) is the only one (other than the simple Lie algebras) 
whose finite dimensional representations are completely reducible. The interests of 
study osp{l,2) are similar to those of sl{2), since it is a basic building block for 
contragredient Lie superalgebras. In [Z], a theory parallel to that of the quantum 
SL(2) was developed for 0Sp(l,2). There the definition of the quantized envelop- 
ing algebra Uq{osp{l,2)) is standard, while the definition of Cg(osp(l,2)) can be 
explained by the Radford-Majid bosonization. In this paper, we turn our atten- 
tion to the homogeneous superspaces associated with Cq{osp{l,2)) and study the 
spherical functions on them. 

In section 2, we recall the basic definitions and results associated with the Z2- 
gradcd Hopf algebras U = Uq{o,sp{l,2)) and A = Cq{osp(1.2)). In section 3, 
we first classify all (<?, g') -primitive elements of U, then study the right and the 
left invariants of these primitive elements. In section 4, we investigate how the 
invariants in section 3 are related to the special (jf-polynoniials via the Askey- Wilson 
scheme. As suggested in [Se], some of the orthogonal polynomials (or g-polynomials) 
obtained from algebras associated with osp(l,2) may be new, but the author has 
no answer to this question at this time. This question deserves further attention. 



(1.7) 



(1.6) 




(1.8) 



{uG Bj : Lx{u) = e{x)u) 
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2. Preliminary 

We recall the definitions and some basic properties of the quantized eveloping 
algebra and the quantum supergroup correspond to osp{l, 2) from [Z]. We assume 
through out that ^ q gC and q is not a root of 1. Let i = and let t = iy^. 

The quantized enveloping algebra U of osp(l, 2) is the Z2-graded associative algebra 
over C generated by k^^,e,f subject to the relations: 

kk — k k — — 1, 
ef + fe= —. 

q-q 

The Z2-grading on U is given by p{k'^^) = and p(e) = p{f) = 1. The Z2-graded 
Hopf algebra structure on U is defined by 

(2.2) A(A;±i) = k^^ ® k^\A{e) e ® 1 + fc ® e, A(/) = / fc"^ + 1 (g) /; 

(2.3) S{k^')^k^', S{e) = -k-'e, S{f) = -fk; 

(2.4) £(fc±i) = l, e(e)=£(/)=0. 

The quantum supergroup A = Cq[osp{l,2)] is the Z2-graded associative algebra 
over C defined by generators a, b, c, d, a with relations 

ab = tba, ac = tea, be = —cb, 

(2.5) bd = —tdb, cd = —tde, ad — da= {t~^ — t)be, 

ad + tbc = a, = 1. 

The Z2-grading on A is given by p{a) = p{d) = p{a) = and p{b) = p{e) = 1. The 
Z2-graded Hopf algebra structure on A is defined by 



(2.6) 




The dual pairing between U and A is provided by 



(2.7) 
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together with the requirements that k^^ are algebra homomorphisins and 

e{xy)=e(x)eiy) + {-ir<'^h{x)e{y), e(l) = 0, 
f{xy) = f{x)k-\y) + i-ir^^^s{x)f{y), /(I) = 0, 

for all x,y ^ A. For u £ U, wc also have 

(2.9) A{u){x (E>y) = u{xy), e{u) = S{u){x) = u{S{x)). 

Recall the following definition of the Gauss' binomial coefiicients: 

'm\ {v;v)m 



m— ± / 
k=0 ^ 



^Jv {v;v)n{v;v) 

m—n 

For each e iZ+, let = {—£, —£+!,...,£} and define two C- vector subspaces 
V/- and V/^ of A by ([Z, Section 5]) 

(2.10) V/=0C4(^) and y/ = 0C^W, 
where 

(2.11) C^=i^^l(,'^,)^^a^-V+^ and ,f ) = 

We shall denote the subspace spanned by the elements ^l^^cr (resp. a) {i £ Ig) 
by Vl"a (resp. V^a). Then each V^^cr* (resp. V^^cr^), s = 0, 1, forms an irreducible 
left (resp. right) ^-subcomodule oi A. Let mf^a^ e le) be the associated 
matrix elements. Then we have 

A(dV) = $:m(jV^^(V, iele, 

(2.12) A(,f)J^) = ^,fa^®^^^ 

A(mgV^) = ^ m'^V^ ® miya^ and £(mgV^) = 6,,. 

Recall the definition of the little g'-Jacobi polynomials (see [MNU, 2.2]): 
where a, /3 G Z, n e Z_|_. Let 

One can compute the matrix elements by the following theorem ([Z, Thm. 6.1]): 
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Theorem 2.1. Let ( = tbca. For i G 5^+, i,j € le, we have 

(1) Ifi + j <0,i> j, then 

(2.13) = a-'-^d-^a'+^N^PP^:^'^—'^ (C; f-'). 

(2) lfi+j<0,j> i, then 

(2.14) mf) = (-l)[^la-^-^6^-V^+'7v}f i^^'-*-^)(C;i-2). 

(3) lfi+j>0,j> i, then 

(2.15) = (-l)[^livi^__.pji7*'^+^)(C;t-2)6^-M'+V^-^". 

(4) Ifi + j>0,i>j, then 

(2.16) mg) = N^Jl_iPt7''^'^ (C; t-^y-^d'+^a'-\ 

For £ G J^, s = 0, 1, let M^ct^ = ^^j^ Cm-jCT*, then M^cr" is a bi-subcomodule 
of ^, and we can define an ^-bicomodule isomorphism $^ : V/"a^®V/^a^ — > M^a^ 

by 

(2.17) $,(^f <T^0r?f a«)=mgV% ijele. 

Theorem 2.2. (7^/, Theorem 1.1 and Theorem 5.1) (1) The set of monomials 
a^Vc^d^a^ , k, I G Z+, i = or I = 0, and s = 0,1, form a basis of A over C. 

(2) Any finite dimensional irreducible left (or right) A-comodule is isomorphic 
to V^^cr" (or V/^a^) (s = 0,1) for some £ G |Z+, and A is decomposed into the 
direct sum of A-bicomodules 

(2.18) -^=0 iMe(BMea). 

Remark. We can define two hermitian forms <,>r and <,>l on A such that the 
decomposition (2.18) is an orthogonal decomposition with respect to both forms, 
for details see [Z, Section 7]. 

3. Primitive elements and homogeneous spaces 

Recall that for a pair of group-like elements {g,g') in a Hopf algebra H, an ele- 
ment X S is called {g, g')-primitivc if A{x) = x®g+g' ®x. If x is {g, (7')-primitivc, 
then the one-dimensional subspace spanned by x is a coideal of H. We will study 
the homogeneous superspaces of A defined by the {g, 5(')-primitive elements of U, 
so we need to describe the {g, 5')-primitive elements. 
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Proposition 3.1. The group-like elements of U are k™,m € Z. For in,n € Z, 
denote by P{m,n) the subspace of all {k"^ , k") -primitive elements ofU. 

(1) Ifm = n, then P{m, n) = 0. 

(2) Ifn-my^ 0, 1, then P{m,n) = C(A;™ - fc"). 

(3) P(0, 1) = Ce ® C/fc © C(A; - 1). 

(4) Ifn-m = 1, then P{m,n) = A;'"P(0, 1). 

Proof. The monomials f^k* {r,s G e Z) form a basis of ZY, we consider 

the action of A on these monomials. By using the formula (which holds in any 
associative algebra for elements x and y satisfying xy = vyx) 

k=0 ^ ^ v ^ 

one can prove 

r s 

(3.1) A(e'-rfc*) =^^c(r,s,i,i;g)e7^-^A:'-*+*®e'-7^fc^-«+*, 

i=0 j=0 

where 

c(r,s,i,i;9) = (-l)('-'+^)(«-^)g('-'-)('^-^) (^^') . 

Order the monomials f^k* lexicographically, and express a group-like element 
u U as a linear combination of this basis. If ce'' f '^k* is the leading term of (/. then 
using (3.1) one can see that c^e^'f^k* (S> e^'fk* shows up in A(m) only if r = .s = 0, 
i.e. u must be a linear combination of the fc*. Then it follows that the group-like 
elements are fc* (t E Z). 

Suppose that m is a (A;™, A;")-primitive element. If both r, s > in the leading 
term f^k* of u, then from 



A(e''/'A:*) = e" f'k* ® fc-^+* + {-If-^ ( J ) e' f'^k* ® fk^ 



-s+t 

- J yy J r,- 

-Q 

one can see that the second term can not be cancelled in A.{u), so s = or r = 0. 
Similar arguments further show that u must be a linear combination of e/c*, fk* , k^ 
{t,t',j G Z). Now the statements in the proposition follow easily by considering 
the action of A on a linear combination of these elements. 

For each £ E ^Z+, U has up to equivalence a unique representation of dimension 
2£+l. The finite-dimensional representations ofU can be realized by the subspaces 
V/'a^ (as right ZY-modules) or V/^a^ (as left ZY- modules) of A. The left actions of 
e, /, fc^^ on the basis lipf^^ can be computed by using the formulas in Theorem 
2.1, and we have 

L,±.(r;fa^) = (-l)^+^■+^^T2^■^fa^ 



(3.2) 



q-q 

Lfir^fan = (-l)i+^i[^l-[^lt^+^- 

(l_t-2(^-i))|(l_f-2(«+j+l))| 



a 
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(£) (i) 

with the convention that and r]l_^-^ are zero. The right actions on the basis 

^I^V* are given by 



(3.3) 



According to Proposition 3.1, the basic (1, fc)-primitive elements are hnear com- 
binations of e, fk and k — 1. Let 

(3.4) Xai3-y = cte + l3,fk + ■ylk — 1), 

whore a,/3,7 G C, not all zero. If one of a,/3,7 is zero, we shall omit it from the 
index, i.e. x^p — ae + j3fk and so on. We consider the invariant subspace of A 
defined by Xafj-^. Note that sixap-y) = 0, so the invariant subspace is the null space 

oiRx^p^ (or L^^f,^). 

By (3.3), for ^ = i, the right action of Xap-y on the basis ^^^^V* corresponds to 
the matrix 

/7((-l)^t-l) -Pt-^ 
V 7((-l)^+^i-^ - 1) 

The determinant of this matrix is equal to 

_i i-i"^ 



(-l)V(-i + 



If 7 = 0, then a/3 must be in order for Xa/s-y to have nontrivial invariant 
subspace in (t", i.e. Xa0-y is a nonzero multiple of e or fk. Note that in both 

cases, there is a one-dimensional invariant subspace for every £ e given by 

^^^V* or S^^^cr^ (respetively). 

If 7 7^ 0, we can assume 7 = 1 and chose a, j3 so that 

(3.5) ap = {-l)%q-q-^). 

Then XajS-^ has a one-dimensional invariant subspace in Vpa^, spanned by the 

2 

element 

(3.6) ((-1)^*-' + 1)^'\^ + 

However if 7 7^ 0, then there is no nontrivial invariants for higher dimensions in 
general. Consider the case £= 1. The matrix of the right action of Xa/s-y on is 

-7(g + l) -P{l-q-^)i 

(3.7) i?.„,,(3)= I -a(l-g-i)-i -27 -m-\l-q-')'^ 

iat-\l- q-'^)-i --f{l + q-^) 
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with the determinant 



det(E^„^j3)) = -2 



7^(1 + 5)' 



and det{Rx^i^^{3)) = if and only if 7 = (under our assumption on q). The 

matrix of the right action of Xa^j on V/'cr is 

(3.8) 

7(9 -1) -P{l-q-')^ 



^x.,,(3,^)= -a(l-g-i)-i 



iat-\l-q-^)--2 7(9-^-1) 



with the determinant 



det(i?^„^ r3,a)) = 2- 



x/3j{q - 1) 



and det (3, cr) = if and only if aPj = 0. Further computations show that 

under condition (3.5), the parameter q must be a root of a polynomial (depending 
on £) in order for the determinant to be 0. The left action can be discussed similarly. 
We summarize the above discussion in the following theorem. 

Theorem 3.2. Let x^is-y be defined by (3.4)- Then in order for the right (or left) 
action of Xapy on A to have nontrivial invariants for all £ e 5^+7 Xafij must be 
scalar multiples of e or fk. The right invariants of the coideal Ce are the linear 
combinations ofrnfja"^ (£ € iZ+;i,j e Ig), and the right invariants of the coideal 
Cfk are the linear combinations of m^^^^u" (£ G \'L+;i,i e h). 

Proof. Use the ^-bimodulc isomorphism defined by (2.17). 

If 7 = and aj3 ^ 0, then Rx^p has a one-dimensional invariant subspace in 
Via'' (s = 0, 1). To treat the general cases, we need the following lemma, which 
can be proved by standard linear algebra arguments. 

Lemma 3.3. Let 



A = 



/ ai 

/3i aa 
/32 as 

















Oln-1 

/ 



Then 



det(yl) = 



0, 



n odd, 



(— 1) 2 q!i/3iq:3/33 • • • Q!„_i/?„_i, n even. 
Hence if all and Pi are nonzero, then the linear system 

AX = 0, X = {xu...,Xnf, 
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has nontrivial solui/ion if and only if n is odd, and if this is the case, the solutions 
are scalar multiples of the column vector X with components 



r 0, 



(-1) 



i even, 
i odd, 



with the convention that xi ~ 1. 

For i G , wc define a^^bi, and q by 

(3.9) i^fe_l(€fV«) = a4^V^ i?e(d'V^) = 64^\a^ Rfk{^'^ a') = c^^f^a^ . 

According to (3.3), 6^ ^ for all i < £ and q 7^ for all — £ < i. Since the matrix 
of on the basis C-]o•^^i^]+lC7^ V** of V/ct^ is 



^x„,(^,a^) 



f /3c_^+i 
ah-i Pc-e+2 
a6_^+i /3c_^+3 





V 









abe-i 



\ 






/ 



by Lemma 3.3, Xa/3 has nontrivial invariant in V/"a^ if and only if 2£ + 1 is odd, 
that is, if and only if f € Z+ , and the invariants are scalar multiples of 



(3.10) 
where 

(3.11) 



iele 



( 1, 

0, 

^ ^ ' nj=i c-«+2, ■ 



if i = -(., 

if i = -^ + 2fc+ 1, 0<A;<£-1, 
iii = -l + 2k, l<k<e. 



Note that 



(3.12) 



k-l 

n ^-^+2j = (-9) 

j=0 



fc^_MjL^(g ^^g')fc^(^g ')! 



(g-g-i)'= 

(t -*-!)'= 



SO we can write 



U.j=o b-e+2j 

n'=iC-£+2,- V^ + i-V (-g-2^+i;g2)2(^-2.^-2)2 



(3.13) 



19 



1-9 



(g-^^;9^)|(-g;g^)| 

(_^-2.+ 1.^2)l(^2.^2)l 
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Now assume 7 7^ but a/3 = 0. For the case a = 0, the matrix of x^^ on V/'a^ 



IS 



7^-^+2 /?C_£+3 









V 



7a£_i /3q 
7a^ / 



and xp^ has nontrivial invariant in Vl'a^ <S4> JliG/f a; = <;4> G and € + s S 2Z 
(by (3.3)). This last condition is equivalent to I = 2r + s,r € Z_|_. Under this 
condition, the one-dimensional invariant subspace is spanned by 



(3.14) 



where 



(3.15) 



r 1, 
0, 



if i = 0, 
if 1 < i < ^, 

if-^< i < -1. 



Note that we can write 



(3.16) 



T-rO 

lij=a+l '^J 



iL2J 



f^i+, ((-g)-^;-g)l.((-g)^+^-g)i 
(i + g)-'(«; 



Similarly, Xa-y has nontrivial invariant subspace if and only if £ = 2r + s, r e Z+, 
and if this is the case, the one- dimensional invariant subspace is spanned by 



(3.17) 



where 



(3.18) 



0, 
1, 



ii-e<i< -1, 

if i = 0, 
if 1< i < ^. 



We also have 



(3.19) 



j=ob, ^ if4i-fi±ii+y ((-g)-^;-g)f((-g)^+^-g)| 



{q-q ^yiq;q)i 



We now summarize our discussion as follows. 
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Proposition 3.4. The right actions of the elements Xafj, Xa-y, andxfj^ have non- 
trivial invariants in V^^cr* only if £ ^ If i £ Z+, then Xa/3 has a one- 
dimensional invariant subspace in Vlo^ for both s = 0, 1 with a basis given by 
(3.10) and (3.11), while Xa-y (resp. xp^) has nontrivial invariants only if i -\- s is 
even, and if this is the case, the one- dimensional invariant subspace is given by 
(3.14) and (3.15) (resp. (3.17) and (3.18)). 

Prom this proposition, we immediately obtain the following theorem. 

Theorem 3.5. Let a,p, and 7 be nonzero complex numbers. 

(1) The right invariant subalgebra of A corresponding to Xai3 is spanned by 

(3.20) ^a;imgV^ £ G Z+, j e le, s = 0, 1, 

where Xi are defined by (3.11). 

(2) The right invariant subalgebra of A corresponding to x^^ (resp. Xf^j) is 
spanned by 

(3.21) ^x.m|fa^ j e h, 

ieit 

where I e Z+ and s = 0, 1 satisfy £-\- s G 2Z+, and Xi are defined by (3.15) (resp. 
(3.18)). 

The left action can be discussed similarly by using (3.2), we give the correspond- 
ing results for the left action here and omit the details. 

Proposition 3.6. The left actions of elements Xap, Xa-y, and Xjs^ have nontrivial 
invariants in V/^a^ only if £ G Z+. Assume £ G let 

(3.22) AS, = ^,,,f.^ 

jeh 

(1) The element x^p has a one- dimensional invariant subspace in V^^cr" for both 
s = 0, 1 spanned by the element (3.22) with 



(3.23) y, = < 



r 1, ifj = -i, 

0, if j = -£ + 2k+l, Q<k<£-1, 

(-Q-i/3)" "r rr'+" , ifj = -£ + 21,, l<k<£, 



where 
(3.24) 



(2) The elements x^-y and Xa-y have nontrivial invariants only if £ -\- s is even, 
and if this is the case, the one- dimensional invariant subspace is given by (3.22) 
with 

if-i<j<-l, 
(3.25) yj = i . ^ */j =0, 
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where 



(3.26) 



or 



(3.27) 



where 



(3.28) 



n 



i=0 S 



^ ^ ^ (t-i-i)^(9;g), 



(_a^-i)-. n-=fj'- , i/-^<j<-i, 



V 0, 



ifi<j<i, 



n 



= (-i)i^i[^l-[ll+/^A(-«)"''-^)-^-«-«)'^''-5)-^- 



(9-g-i)-J(g; g)_ 



respectively. 



The corresponding left invariant subalgebras are described by the following the- 
orem. 

Theorem 3.7. Let a, (3, and 7 he nonzero complex numbers. 

(1) The left invariant subalgebra of A corresponding to Xaj3 is spanned by 



(3.29) 



jeie 



where yj are defined by (3.23) and (3.24-). 

(2) The left invariant subalgebra of A corresponding to Xa-^ (resp. xp-y) is 
spanned by 



(3.30) 



where £ € Z+ and s = 0, 1 satisfy i + s & 2Z+, and yj are defined by (3.25) and 
(3.26) (resp. (3.27) and (3.28)). 

4. Zonal spherical functions and Askey- Wilson polynomials 

In this section, we consider the roles of some polynomials from the Askey- Wilson 
scheme play in the invariants we discussed in the previous section. We keep the 
notation of the previous section. Recall the definitions (see [Ko]) of the ^-shifted 
factorials and the g-hypergeometric series 



m — 1 



{a\q)m= ]J(l-a?''), {ai, ■.■,ar\q)m = '[\{af,q)r 

{ai,...,as+i;q)kz'' 



s+Ws 



fc=0 

0-1, 0,3+1 
bi,...,bs 



E 

k=0 



{bi,...,bs;q)k{q;q)k' 
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Recall also the Askey- Wilson polynomials 



p„{cos9; a, b, c, d\q) = a "'{ab, ac, ad; q)A4>z 



ab, ac, ad 



which satisfy the recurrence relation 

- (1 - - g"-^a6cd)P„(e'^) 

= A{e)){E,{qe'<') - P„ie">)) + A(-(^)(P„(g-ie'«) - P„(e''^)), 

and the dual g-Krawtchouk polynomials 

i2n(g-" - 9"-'^-^; 5^ N\q) = 3</.2(9-", q, q). 

Let ^ e Z+ and let 

(4.1) = 

ieit 

The condition -Rx„^ (^^) = is equivalent to 
(4.2) 

^,I^HI^l,.-..('-'-'"-^';)^0;-'-"'"')%... 

_ (1 - ^'^'^^^q - ^^^^ ^ 

with the convention that X-^-i = xe+i = 0. We can rewrite (4.2) as 

(4.3) ia-^^{t-'+'-^ - t'-'+Y^r'-' - t'+'f^Xi-i 

- (3t-i{t-^-'-^ - t^+i+^)i{t-^+^ - t^-^)ixi+i = 0. 

If we choose 

(4.4) a=l + i-2 /3 = i^^ 
then (4.3) becomes 

(4.5) it-^t-^+'-^ -t^-'+^)^t-^-' -t^+')ixi-i 

- iti{t-^-'-^ - f^+'+i)i(t-W _ t^-i)ixi+i = 0. 

As indicated in [Ko], it is helpful to replace the above homogenous system with 
the problem of finding the possible eigenvectors of the coefficient matrix of (4.5), 
i.e., consider the following system of equations 



(4.6) ii-5(t-^+'-i - t^-^+i)3(t-^-* - t^+^)ix 



i-i 
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The solutions of (4.5) are given by the eigenvectors correspond to the zero eigenvalue 
of (4.6). Note that (4.6) is a special case of the identity [Ko, (4.9)], so [Ko, Theorem 
4.3] implies that the eigenvalues are 

and the corresponding eigenvectors are given by constant multiples of 

2e 

n=0 

where 

Rn{i, = 3</)2(t-'", t-^'-^\ 0, t\ e) 

= 3</'2((-g)-", {-qr-',-{-qy-'; 0, q-^'; -q, -q) 

is the dual g-Krawtchouk polynomial. Hence the right invariants of (see The- 
orem 3.5) can also be expressed in terms of some special dual gr-Krawtchouk poly- 
nomials. Similar discussions hold for the left invariants. 

The spherical functions are obtained by taking the intersections of the right and 
the left invariants. If the right invariants of Xa/d-y in V/"a^ are given by constant 
multiples of 

Pa/37 ^ '■^i ^ ' 

and the left invariants of Xa' ^'y in V/^a^ are given by constant multiples of 

then the (a;Q/3-y, Xa//3/-y')-spherical functions in M^a^ are given by constant multiples 
of 

Consider (a:;a/3,a;„'/3')"Spherical functions. By Proposition 3.4 and Proposition 

3.6, there exists a one-dimensional subspacc of (a:;^^, a;Q'^')-sphcrical fimctions in 
every M^a", with Xi given by (3.11) and yj given by (3.23). The spherical functions 
in Mia^ are given by constant multiples of 
(4.7) 

pi = (a^ + (a')-^P't{l - q)b^ + ap-^tq{l - q)-^c^ + al3-^{a')-^ (3' q^S) a'. 
Note that by (2.7), 

(4.8) fc'"(pi) = (-l)"^(t2'" + al3-^{a')-^l3'q^t-'^"') 

= (-l)'»(^+i)(^'» + q/3-1(q')-1/?'^-'"+2). 

Since we have the following tensor product decomposition 

n 

(4.9) {Mia')'^" = M.a"', 

i=0 
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up to constant multiples, the {xaf3, Xa' f:)')-sphcTical functions in Afncr*" are given 
by a polynomial Pn{pi) of degree n in the variable p\. To obtain information on 
this polynomial, consider the following element of U 

(4.10) r = e/+ , ^^''+/^'''^ ^ =-/e+ , 

This element belongs to the super center of U (i.e. commutes with even elements 
and super commutes with odd elements). By (3.3), (3.11), (3.22) and (3.23), we 
have 



(4.11) 

Wc claim that 
(4.12) 



+ UXa'P' + XajjU, 

where v = {a')~^ (5' a^~^ . For x and y inU, we write x yify G x+Uxa'p'+XapU. 
To prove the claim, we first note that 

fc-e/ = g"(e + ^fk)k"'f - q"'-'^fk"\fk + ^e) + vq'^-'fk^'e 
a' a' p 

q-q-^ 

implies 

(4.13) (1 + V'""^)fc"e/~ V""^^^^ • 



q-q- 



Then we add 



to both sides of (4.13) and multiply through by t{t - i"^)(g - g"^)(l + wg^™"^)"^ 
to prove (4.12). 

By (1.6) and (4.10), we have 

(4.14) (fc"T)(P„(pi)) = fc™(Lr(P„(pi))) 

f2n+l I f-2n-l 

= (-')• (,-,-0(,-«-) ^"''^"<'"»^ 

Let 

fc™(P„(pi)) = P„(r). 
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Then (4.12) and (4.14) imply that 

(4.15) ((-l)^+"(q-'" - (7"+i) + q - l)P„(g™) 



1 — vq 



2m 



1 + vq 



2m- 



+ 7lZq-rn-'l iMr-')-Pnir)). 

Consider the special case when {a')~^(3'a(3~^ = 1. Note that 

i-g'" ^ (i-r"')(i + r"') 

_ (1 - g")(l + g'")(l - ig'")(l + ig") 

SO if we let = te^^, then 

l-g2m _ (l-te'^)(l + fe'^)(l-ite'^)(l+ite*^) 
^ ■'^^> 1 + g2m-i - (i_e2ie)(i_ge2i«) • 

Denote this last expression by f{9), then 

g2m-l _ ^ 

By (4.9), we can replace s in (4.15) by ns'. So we can write (4.15) as 
(4.17) 

= f{0){Pn{q"'+') - Pn{qn) + f{-0){Pn{q'^-') - Pn{qn)- 

If we start with M\<j (compare with (4.9)), then s' = 1, and by (4.8), we can 
write (4.17) as 

(4.18) 

{q-^ -q^+^ +q-l)Pn{te'') 

= m{Pn{qte'') - Pn{te'')) + f{-9){Pn{q-He'') - Pn{te'')). 

Compare (4.18) with the recurrence relation for the Askey- Wilson's polynomials, 
we have 



Pn{te^ ) = constant x icj)^ 



q, -iq, iq 



Therefore, if (a') ^f3'af3 -'^ = 1, the (xq,/?, a;Q,//3/)-spherical functions in Mncr" are 
constant multiples of the Askey- Wilson polynomial 



Pn{pi;t,-t, it,-it\q). 
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Let us now consider the (aia/j, a;^'-y')-spherical functions as another example. In 
this case, we have 

(4.19) A;"Tg f-g2'»-i^i2^ + ^ J-^ 



a(/3')2 (g-9-i)(i-i-i) 



a(/3')2 (g-g-i)(t-t-i), 

2m-l ^ ^-l^j^m ^ ^ 



If we choose 

(4.20) a = q-q-\ /3 = 1, /3' = i-t-\ 7' = !, 
then (4.19) becomes 

_ 2m-l I 1 _|_ -1 

(4.21) ^"'r^ (;_,-.)(,_,-V (^'""^-^"') 

J2m-2 I 1 I „ 



(^_g-l)(t_t-l) 

-A;'". 



(^_^-i)(i_i-i) 

For the choice of (4.20), the right Xa/3-invariants in V-^a are constant multiples of 

(4.22) pi^=d\V + ii(l + a)^iV, 

and the left a;/3'T,'-invariants in V^-a are constant multiples of 

(4.23) X^,^, = (1 - 9)^^'V + q{l + q)ri\a. 
Hence the spherical functions in M\<j are constant multiples of 

(4.24) pi = ((1 -q)^ab + iq{l + q)h^ + i(l + q){l -q)^dc + itq{l + qf(f)a. 

By (4.9), the spherical functions in Mna" are constant multiples of a polynomial 
P„(pi) of degree n in pi. Let A:"(P„(pi)) = P„(g™). Then by (4.21), i?„(g'") 
satisfy the following recurrence relation 

(4.25) (g2™-i - q-' - l)(i?„(g'"+i) - i?„(g'")) 
+ ((Z^™-^ + q + l)(i?„(g™-i) - i?„(9")) 

= (g"+' + + g - g-"-' - g-" - g-i)i?„(g™). 
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